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DETAILED ACTION 
Response to Arguments 

1 . Applicant's arguments with respect to claims 1, 3, 29, 3 1 , 38 and 43-48 have been 
considered but are moot in view of the new ground(s) of rejection. 



1 . The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth 
in section 102 of this title, if the differences between the subject matter sought to be patented and the prior 
art are such that the subject matter as a whole would have been obvious at the time the invention was made 
to a person having ordinary skill in the art to which said subject matter pertains. Patentability shall not be 
negatived by the manner in which the invention was made. 



2. Claims 1, 3, 38, 43, 44, 47 and 48 are rejected under 35 U.S.C. 103(a) as being 



unpatentable over Hashimoto (U.S. 4,768,085) in view of Jacobs (U.S. 6,580,456) and Lee at al. 
(U.S. 6,466,265). 

Regarding claim 1, Hashimoto '085 discloses a color imaging system providing on-the- 
fly color interpolation using analog signals to reconstruct colors during sensor readout (Fig. 3, 
col. 3, lines 55-68), the imaging system comprising: 

an array of pixel sensor elements wherein at least part of the array is arranged in rows and 
columns (Fig. 1; col 3, lines 40+); 



Claim Rejections - 35 USC§103 
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a color filter including a plurality of color filter components organized in a predefined 
pattern, the color filter overlaying at least a portion of the array (i.e., noted from Figs. 1 and 4 
that the color filter components are organized in a predefined pattern); 

a readout control circuit coupled to the array (i.e., noted the element 2a as shown in Fig. 
2; col. 4, lines 5+); 

an array controller coupled to the array (i.e., see Fig. 2; col. 4, lines 5+); 

wherein the readout control circuit (2a) and the array controller (2a, 2al and 2a2) are 
configured to simultaneously read out values for a group of pixel elements from two different 
rows and two pixel elements from two different columns (i.e., Figs. 2, 7 and 12; col. 3, lines 54+, 
and col. 5, lines 60+) and 

to reconstruct color components for at least a first pixel sensor element and a second 
pixel sensor element using color information (i.e., noted that the G signal is reconstructed from 
the pixels' signals such as Gl and G2 as shown in Figs. 2 and 3) from other pixels elements (i.e., 
noted the pixel elements nH/mH as shown in Fig. 1) within at least the first portion of the array 
while the readout control circuit is reading said first portion of the array (i.e., col. 4, lines 20+ 
and col. 5, lines 1+). 

In addition, it is noted that although Hashimoto '085 shows the readout control circuit 
(Fig. 2, the elements 2a) generating the specific reading pattern while the readout control circuit 
is reading the portion of the sensor array (i.e., see Figs. 1 and 2), Hashimoto f 085 does not 
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explicitly stated the use of a pattern generator that is programmed by a digital command as 
amended in present claimed invention. 

However, the above-mentioned claimed limitations are well known in the art as 
evidenced by Jacobs '456. In particular, Jacobs '456 teaches that it is conventionally well 
known in the art at the time the invention was made to use the readout control circuit (Figs. 2, 7 
and 8; the elements 204, 702 & 704) comprises a pattern generator (i.e., Fig. 8, the elements 808, 
828 and 804) that is programmed by a digital command (i.e., see col. 7, lines 35+, col. 8, lines 
40+, col. 9, lines 40+ and col. 11, lines 35+), thereby providing flexibility, and allows the clock 
signals to be modified easily and at a low cost (i.e., see col. 16, lines 10-15). 

In view of the above, having the system of Hashimoto '085 and then given the well- 
established teaching of Jacobs '456, it would have been obvious to one having ordinary skill in 
the art at the time the invention was made to modify the system of Hashimoto '085 as taught by 
Jacobs '456, since Jacobs '456 states at col. 16, lines 10+ that such a modification would provide 
flexibility, and allows the clock signals to be modified easily and at a low cost. 

Furthermore, it is noted that although Hashimoto '085 shows the use of a plurality of 
color amplifiers (i.e., noted from Fig. 3 that each of the amplifiers 3, 4 and 5 are corresponding 
to one the colors of light), Hashimoto '085 does not explicitly state that the amplifier has a 
programmable gain as recited in the present claimed invention. 

However, the above-mentioned claimed limitations are well known in the art as 
evidenced by Lee '265. In particular, Lee '265 teaches in order to achieve high pixels output rate 
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for high frame rates, it is conventionally well-known in the art to use a plurality of color 
amplifiers (i.e., noted the amplifiers 92 and 93 as shown in Figs. 2e, 4 and 5) each corresponding 
to one of the colors (i.e., noted the R, G and B color signals read out from the pixels 1, 2, 3 and 4 
as shown in Fig. 2b) of lights wherein each of the color amplifiers has a programmable gain (i.e., 
col. 4, lines 25+, col. 5, lines 25+; Figs. 4 and 5). 

In view of the above, having the system of Hashimoto '085 and then given the well- 
established teaching of Lee '265, it would have been obvious to one having ordinary skill in the 
art at the time the invention was made to modify the system of Hashimoto '085 as taught by Lee 
'265, since Lee '265 states at col. 1, lines 50+ that such a modification would achieve high pixels 
output rate for high frame rates thereof. 

Regarding claim 3, Hashimoto '085 discloses wherein the readout control circuit is 
adapted to perform color interpolation using two pixel sensor elements read out in parallel (i.e., 
col. 3, lines 60+ and col. 6, lines 14+). 

Regarding claim 43, it is noted that Hashimoto '085 does not explicitly states the use of 
CMOS Sensor, however, Lee '265 teaches that it is conventionally well-known in the art at the 
time the invention was made to use CMOS sensors in order to realize either high frame rate or 
high pixel count thereof (i.e., see col. 1, lines 25-55 of Lee '265). In view of this, it would have 
been obvious to one having ordinary skill in the art at the time the invention was made to modify 
the system of Hashimoto '085 as taught by Lee '265, since Lee '265 states at col. 1, lines 50+ that 
such a modification would achieve high pixels output rate for high frame rates thereof. In 
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addition, Jacobs '456 also teaches that it is well known in the art to use the CCD or CMOS 
sensor in the camera device (i.e., see col. 1, lines 23+ of Jacobs '456). 

Regarding claim 44, although Hashimoto '085 shows the use of color filter components 
(i.e., col. 4, lines 5+ of Hashimoto '085), Hashimoto '085 does not explicitly state the use of a 
Bayer pattern color filter as recited in the present claimed invention. 

However, Lee '265 teaches that it is conventionally well-known in the art at the time of 
the invention was made to use a Bayer pattern color filter as recited in the present claimed 
invention (i.e., col. 3, lines 20+ of Lee '265). In view of this, it would have been obvious to one 
having ordinary skill in the art at the time the invention was made to modify the system of 
Hashimoto '085 as taught by Lee '265, since Lee '265 states at col. 1, lines 50+ that such a 
modification would achieve high pixels output rate for high frame rates thereof. 

Regarding claim 38, Hashimoto '085 discloses a color imager (i.e., Figs. 3, 5, 8 and 10) 
comprising: 

a first light sensor which generates a first analog output signal related to the amount of a 
first color of light sensed (i.e., noted the sensor of the sensor 2 of the imager generates the first 
analog output signal such that the green signal Gl as shown in Fig. 8 and 9; see col. 6, lines 
10+); 

a second light sensor which generates a second analog output signal related the amount of 
said first color of light sensed (i.e., noted the sensor of the sensor 2 of the imager generates the 
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first analog output signal such that the green signal G3 as shown in Fig. 8 and 9; see col. 6, lines 
10+); 

a third light sensor (i.e., The Blue sensor of the sensor 2) which generates a third analog 
output signal related to the amount of a second color of light sensed (i.e., noted the sensor of the 
sensor 2 of the imager generates the third analog output signal such that the blue signal B2 as 
shown in Fig. 8 and 9; see col. 6, lines 10+); 

a fourth light sensor (i.e., The Red sensor of the sensor 2) which generates a fourth 
analog output signal related to the amount of a third color of light sensed (i.e., noted the sensor 
of the sensor 2 of the imager generates a fourth analog output signal such that the red signal R as 
shown in Fig. 8 and 9; see col. 6, lines 10+); 

a circuit configured to read out the first, second, third, and fourth analog values at the 
same time (i.e., col. 3, lines 55-68 and col. 5, lines 60+); and 

an interpolation circuit configured to receive said first output signal and said second 
output signal (i.e., col. 3, lines 55+), wherein said interpolation circuit provides an interpolation 
signals on the fly based on at least said first analog output signal and said second analog output 
signal (col. 6, lines 5+). 

In addition, it is noted that although Hashimoto '085 shows the readout control circuit 
(Fig. 2, the elements 2a) generating the specific reading pattern while the readout control circuit 
is reading the portion of the sensor array (i.e., see Figs. 1 and 2), Hashimoto '085 does not 
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explicitly stated the use of a pattern generator that is programmed by a digital command as 
amended in present claimed invention. 

However, the above-mentioned claimed limitations are well known in the art as 
evidenced by Jacobs '456. In particular, Jacobs '456 teaches that it is conventionally well 
known in the art at the time the invention was made to use the readout control circuit (Figs. 2, 7 
and 8; the elements 204, 702 & 704) comprises a pattern generator (i.e., Fig. 8, the elements 808, 
828 and 804) that is programmed by a digital command (i.e., see col. 7, lines 35+, col. 8, lines 
40+, col. 9, lines 40+ and col. 1 1, lines 35+), thereby providing flexibility, and allows the clock 
signals to be modified easily and at a low cost (i.e., see col. 16, lines 10-15). 

In view of the above, having the system of Hashimoto '085 and then given the well- 
established teaching of Jacobs '456, it would have been obvious to one having ordinary skill in 
the art at the time the invention was made to modify the system of Hashimoto '085 as taught by 
Jacobs '456, since Jacobs '456 states at col. 16, lines 10+ that such a modification would provide 
flexibility, and allows the clock signals to be modified easily and at a low cost. 

Furthermore, it is noted that although Hashimoto '085 shows the use of a plurality of 
color amplifiers (i.e., noted from Fig. 3 that each of the amplifiers 3, 4 and 5 are corresponding 
to one the colors of light), Hashimoto '085 does not explicitly state that the amplifier has a 
programmable gain as recited in the present claimed invention. 

However, the above-mentioned claimed limitations are well known in the art as 
evidenced by Lee '265. In particular, Lee '265 teaches in order to achieve high pixels output rate 
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for high frame rates, it is conventionally well-known in the art to use a plurality of color 
amplifiers (i.e., noted the amplifiers 92 and 93 as shown in Figs. 2e, 4 and 5) each corresponding 
to one of the colors (i.e., noted the R, G and B color signals read out from the pixels 1, 2, 3 and 4 
as shown in-Fig. 2b) of lights wherein each of the color- amplifiers has a programmable gain (i.e., 
col. 4, lines 25+, col. 5, lines 25+; Figs. 4 and 5). 

In view of the above, having the system of Hashimoto '085 and then given the well- 
established teaching of Lee '265, it would have been obvious to one having ordinary skill in the 
art at the time the invention was made to modify the system of Hashimoto '085 as taught by Lee 
'265, since Lee '265 states at col. 1, lines 50+ that such a modification would achieve high pixels 
output rate for high frame rates thereof. 

Regarding claim 47, please see the Examiner's comments with respect to claim 43 as 
discussed above. 

Regarding claim 48, please see the Examiner's comments with respect to claim 44 as 
discussed above. 

3. Claims 45 is rejected under 35 U.S.C. 103(a) as being unpatentable over Hashimoto '085 
in view of Jacobs '456 and Lee '265 as applied to claims discussed above, and further in view of 
Wilder et al. (U.S. 5,262,871). 

Regarding claim 45, although the combination of Hashimoto '085, Jacobs '456 and Lee 
'265 teaches the use of a control circuit is programmed to selectively reading groups of pixel 
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elements to create a color reconstruction (i.e., noted Figs. 1 and 2 of Hashimoto '085; and Figs. 
2a-3b of Lee 765), the combination of Hashimoto '085, Jacobs '456 and Lee '265 does not 
explicitly state that the readout control circuit is programmed to selectively skip some of the 
groups of pixel elements to create a lower resolution. 

However, the above-mentioned claimed limitations are well known in the art as 
evidenced by Wilder '871. In particular, Wilder '871 teaches that it is conventionally well- 
known in the art at the time of the invention was made to program the readout control circuit 
(i.e., noted the readout control circuit as shown in Fig. 1 of Wilder '871) for the purpose of 
selectively skip some of the groups of pixel elements to create a lower resolution image (i.e., i.e., 
noted that the groups of pixel elements as shown in Figs. 2 may be selectively skipped during the 
specific resolution mode as discussed in col. 6, lines 50+; see col. 3, lines 20+ and col. 6, lines 
2+ of Wilder '871). 

In view of the above, having the combination of Hashimoto '085, Jacobs '456 and Lee 
'265 and then given the well-established teaching of Wilder '871, it would have been obvious to 
one having ordinary skill in the art at the time the invention was made to modify the system of 
Hashimoto '085 as taught by Wilder '871, since Wilder '871 states at col. 2, lines 50+ that such a 
modification would achieve high speed data capture rate for high frame rates thereof. 
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4. Claims 29 and 31 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Maenaka et al. (U.S. 5,555,023) in view of Jacobs '456 (U.S. 6,580,456). 

Regarding claim 29, Maenaka '023 discloses a method of interpolating color components 
of an array of pixel sensor-elements (col. 3, lines 40+ and col. 6, lines 45+), said method — 
comprising: 

reading a first rectangular portion of an array of pixel sensor elements simultaneously, 
wherein the first rectangular portion includes pixel sensor elements from at least two array 
columns and two array rows (i.e., Fig. 8; col. 1, lines 45-50, col. 2, lines 45+); 

reading a second rectangular portion of the array of pixel sensor elements, wherein the 
second portion partly overlaps said first portion (i.e., Fig. 8; col. 1, lines 45+ and col. 2, lines 
45+); and 

reconstructing color components using interpolation for at least a third portion of the 
array while said third portion of the array is being read (i.e., Figs. 2 and 8-9; col. 2, lines 35+, 
col. 6, lines 35+ and col. 7, lines 20+), and wherein said interpolation comprises summing values 
of two or more said pixel sensor elements (i.e., see Fig. 2, the elements 269-270 and col 6, lines 
10-60). 

In addition, it is noted that although Maenaka '023 shows the reading of the first and 
second rectangular portions (i.e., see Fig. 8) is controlled by the readout control circuit (Fig. 1, 
the elements 30 and 31) generating the specific reading pattern while the readout control circuit 
is reading the first and second portions of the sensor array (i.e., see Figs. 1, 4 and 8), Maenaka 
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'023 does not explicitly stated the use of a pattern generator that is programmed by a digital 
command as amended in present claimed invention. 

However, the above-mentioned claimed limitations are well known in the art as 
evidenced by Jacobs '456. In particular, Jacobs '456 teaches that it is conventionally well 
known in the art at the time the invention was made to use the readout control circuit (Figs. 2, 7 
and 8; the elements 204, 702 & 704) comprises a pattern generator (i.e., Fig. 8, the elements 808, 
828 and 804) that is programmed by a digital command (i.e., see col. 7, lines 35+, col. 8, lines 
40+, col. 9, lines 40+ and col. 1 1, lines 35+), thereby providing flexibility, and allows the clock 
signals to be modified easily and at a low cost (i.e., see col. 16, lines 10-15). 

In view of the above, having the system of Hashimoto '085 and then given the well- 
established teaching of Jacobs '456, it would have been obvious to one having ordinary skill in 
the art at the time the invention was made to modify the system of Hashimoto '085 as taught by 
Jacobs '456, since Jacobs '456 states at col. 16, lines 10+ that such a modification would provide 
flexibility, and allows the clock signals to be modified easily and at a low cost. 

Furthermore, it is noted that Maenaka '023 does not explicitly states the use of CMOS 
Sensors, however, Jacobs '456 teaches that it is conventionally well-known in the art at the time 
the invention was made to use CMOS Sensors in the camera to enhance flexibility thereof (i.e., 
see col. 1, lines 15-25 & col. 2, lines 10+ of Jacobs '456). In view of this, it would have been 
obvious to one having ordinary skill in the art at the time the invention was made to modify the 
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system of Maenaka 4 023 as taught by Jacobs 4 456, since Lee '265 states at column 2 5 lines 10+ 
that such a modification would enhance flexibility. 

Regarding claim 31, Maenaka '023 discloses wherein reconstructing color components 
(i.e., the R, G and B signal as shown in Fig. 8) using interpolation is performed in real-time (i.e., 
noted the color components are interpolated as read out from the CCD sensor in real-time as 
claimed). 

5. Claim 46 is rejected under 35 U.S.C. 103(a) as being unpatentable over Maenaka ! 023 in 
view of Jacobs '456 as applied to claims discussed above, and further in view of Lee at al. (U.S. 
6,466,265). 

Regarding claim 46, although Maenaka '023 shows the use of color filter components 
(i.e., Fig. 8 of Maenaka '023), Maenaka '023 does not explicitly state the use of a Bayer pattern 
color filter as recited in the present claimed invention. 

However, Lee '265 teaches that it is conventionally well-known in the art at the time of 
the invention was made to use a Bayer pattern color filter as recited in the present claimed 
invention (i.e., col. 3, lines 20+ of Lee '265). 

In view of this, it would have been obvious to one having ordinary skill in the art at the 
time the invention was made to modify the system of Maenaka '023 as taught by Lee '265, since 
Lee '265 states at col. 1, lines 50+ that such a modification would achieve high pixels output rate 
for high frame rates thereof. 
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Conclusion 



6. Applicant's amendment necessitated the new ground(s) of rejection presented in this 
Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). 
Applicant is reminded of the extension of time policy as set forth in 37 CFR 1 . 1 36(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the date of this 
final action. 

7. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Aung S. Moe whose telephone number is 703-306-3021 . The 
examiner can normally be reached on Mon-Fri (9-5). 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Wendy Garber can be reached on 703-305-4929. The fax phone number for the 
organization where this application or proceeding is assigned is 703-872-9306. 
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Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 
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